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DETAILED ACTION 
Examiner's Response to Applicant's Remarks 

1 . Applicant's arguments submitted on 06/14/2005 with respect to claims 1 -6, 1 2- 
13, 28-86 and 88-91 have been reconsidered but are not deemed persuasive for the 
reasons set forth below. 



Examiner's Responses to Applicant's Remarks are listed below: 

2. Applicant argues (under REMARKS section) that, Chen does not teach receiving 
an indication of a plurality of annotations selected by a user, wherein each of the 
plurality of annotations corresponds to a media stream or to one or more media 
streams; presenting a plurality of annotation identifiers to the user; allowing the ordering 
of the plurality of annotation identifiers to be changed by the user; seamlessly providing 
one or more of , the plurality of annotations, and at least a portion of the media stream 
corresponding to each of the plurality of annotations; wherein seamlessly providing 
comprises seamlessly providing the one or more of the plurality of annotations and the 
portions of the media stream corresponding to each of the plurality of annotations in an 
order defined by the order of the plurality of annotation identifiers. 

Examiner respectfully disagrees. Chen teaches receiving an indication of a 

plurality of annotations (i.e., "Hie meta-information encompasses the inherent properties of the media. 
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hierarchical information, semantic description, as well as annotations that provide support for hierarchical access, 
browsing, searching, and dynamic composition of continuous media. " The preceding text excerpt clearly states that 
meta information which includes annotation provides support for dynamic con:q)osition of continuous media i.e., 
movie. Therefore Applicant's argument that Examiner's imderstanding that Chen describes using "annotations" for 
dynamic composition of a movie is incorrect is not correct. ' Now what is annotation in Chen's document? 
"Annotations: Hyperlink specifications for objects inside the media stream" The preceding text excerpts clearly 
indicate that Hyperlinks are annotations. The text excerpts also show that armotations/ hyperlink specifications 

correspond to media streams.) (page 3) Selected by a user, wherein each of the plurality of 
annotations (page 3) corresponds to a media stream or to one or more media streams (i.e., 
a movie (i.e., audio and video)) (page 7); presenting a plurality of annotation identifiers (i.e. the 
hierarchical indexes in Figure 4) to the user; allowing the Ordering of the plurality of annotation 

identifiers to be changed by the user (i.e., The Examiner akeady has shown that annotations are 

hyperlinks, and the armotations are used for dynamic conq)osition of continuous media e.g., movie. The Applicant 
argues that Chen does not teach presenting armotations with then corresponding media stream in the desired order 
and does not allow reordering the armotations. new sequence of video and audio should be composable of 
whole, or parts of existing clips, ... Our model of continuous media integrates video and audio documents with their 
meta information. That is meta information is stored together with the encoded video and audio. Several classes of 
meta information are included in the model. These are: ... Annotations: Hyperlink specifications for objects inside 
the media streams" The preceding text excerpts clearly indicates that meta information, which includes annotations 
(i.e., hyperlinks) are stored with their corresponding media streams. Now the question is does the armotations allow 
reordering the actual movie segments? "The continuous media model also allows dynamic composition. A video 
presentation can use parts of existing movies as components. For example, a presentation of Urbana-Champaign 
can be a video composed of several segment from other movies. As shown in Figure 7, the campus overview 
segment can be used in the composition. " The preceding text excerpts clearly indicate that a continuous media e.g., 
movie can be dynamically con^osed of movie segments/clips from other movies i.e., the clips can be mixed and 
matched or reordered. Now the question is how does Chen do it? ''Project Vosaic bases its architecture on the 
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continuous media model outlined above, Meta-information is stored on the server side together with the media clips, 
... Semantic descriptions and annotations are used for searching video material and hyperlinking inside video 
streams. We designed and implemented tools for the extraction and construction of continuous media meta- 
information. A parser was developed to extract inherent properties from encoded mpeg video and audio streams. A 
link-editor was implemented for the specification of hyperlinks within video streams. " 
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The preceding text excerpts and the figures clearly indicates that meta information i.e., information about video clips 
includes semantic descriptions and annotations. Semantic descriptions describe/ represent the video clip and the 
annotation i.e., hyperlinks (The Examiner has already shown that annotations are hyperlinks) actually links 
different clips. Chen teaches a link editor where the annotations provide support for the conposition of the reordered 
video clips. "We are also experimenting with dynamic composition of video. For example, Figure 5 illustrates the 
result of search on a video database. The search result is a server generated dynamic composition of the matched 
clips. The resulting presentation is a movie made up of video clips in the search result In general, users may use 
dynamic composition facilities to create and author continuous media presentations by reusing video segments 
through this facility. The organization of video through dynamic composition reduces the need for the copying of 
large video and audio documents, ... Video frames are grouped and descriptions are associated with the groups. 
The descriptions are stored and used for search and hierarchical structure presentation, " The preceding text 
excerpts reinforces the topic of previous discussion. The semantic descriptions are associated with a group of 
frames or clips. With the help of a link editor a client can dynamically con^jose a continuous media i.e., movie (i.e., 
it does not require any user intervention during the length of the play) by specifying the order of annotations (i.e., 
hyperlinks). A continuous media is continuous because it does not require any user intervention during the play of 
the movie. Finally, The Applicant's argument that Chen does not teach "graphically ordering the annotations and 
sequentially presenting the annotations along with their corresponding identified media stream segments in the 
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desired order" is not proper.) (page 3; page 7; page 11; page 14); SeamleSSly (i.e., "The goal of Vosaic 
project[4] is to seamlessly integrate the organization, retrieval and navigation of continuous media into the World 

Wide Web.") (page 2) providing One or more of . the plurality of annotations, and at least a 
portion of the media stream (page 7) corresponding to each of the plurality of annotations 
(page 3; page 7; page 1 1; page 14); wherein seamlessly (page 2) providing comprises seamlessly 
(page 2) providing the one or more of the plurality of annotations and the portions of the 
media stream (page 7) corresponding to each of the plurality of annotations in an order 
defined by the order of the plurality of annotation identifiers (page 3; page 7; page ii; page 14). 



Any other arguments by the applicant are more limiting than the claimed 
language. 



Double Patenting 

3. The nonstatutory double patenting rejection is based on a judicially created 
doctrine grounded in public policy (a policy reflected in the statute) so as to prevent the 
unjustified or improper timewise extension of the "right to exclude" granted by a patent 
and to prevent possible harassment by multiple assignees. See In re Goodman, 1 1 
F,3d 1046. 29 USPQ2d 2010 (Fed. Cir. 1993); In re Longi, 759 F.2d 887. 225 
USPQ 645 (Fed. Cir. 1985); In re Van Omum, 686 F.2d 937. 214 USPQ 761 (CCPA 
1982); In re Vogel, 422 F.2d 438. 164 USPQ 619 (CCPA 1970);and. In re Thorington, 
418 F.2d 528. 163 USPQ 644 (CCPA 1969). 

A timely filed terminal disclaimer in compliance with 37 CFR 1.321(c) may be 
used to overcome an actual or provisional rejection based on a nonstatutory double 
patenting ground provided the conflicting application or patent is shown to be commonly 
owned with this application. See 37 CFR 1.130(b). 

Effective January 1 , 1994, a registered attorney or agent of record may sign a 
terminal disclaimer. A terminal disclaimer signed by the assignee must fully comply with 
37 CFR 3.73(b). 
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4. Claims 1-6,12-13 and 28-91 are rejected under the judicially created doctrine of 
obviousness-type double patenting as being unpatentable over claims 1-39 of Chaddha 
et al. (U.S. Patent No. 6,173,317). claims 1-25 of Gupta et al. (U.S. Patent No. 
6,484,156). Although the conflicting claims are not identical, they are not patentably 
distinct from each other because claims of U.S. Patent No. 6,173,317 and U.S. Patent 
No. 6,484,156 contain every element of claims 22-23 of the instant specification. 

"A later patent claim is not patentably distinct from an earlier patent claim if the 
later claim is obvious over, or anticipated by, the earlier claim. In re Longi, 759 F.2d at 
896, 225 USPQ at 651." 



Claim Rejections - 35 USC § 102 

5. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(a) the invention was known or used by others in this cx)untry, or patented or described in a printed 
publication in this or a foreign country, before the invention thereof by the applicant for a patent. 

6. Claims 1-6.12-13 and 28-91 are rejected under 35 U.S.C. 102(a) as being 
anticipated by Chen et al. (Video and Audio: Organization and Retrieval in the WWW, 
Vosaic corporation, 1996 and Chen hereinafter). 
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As to claims 1-6,12-13 and 28-86 and 88-91, Chen teaches receiving an 

indication of a plurality of annotations (i.e., "The meta-information encompasses the inherent properties 

of the media, hierarchical information, semantic description, as well as annotations that provide support for 
hierarchical access, browsing, searching, and dynamic composition of continuous media. " The preceding text 
excerpt clearly states that meta information which includes annotation provides support for dynamic conq)osition of 
continuous media i.e., movie. Therefore Applicant's argument that Examiner's understanding that Chen describes 
using "annotations" for dynamic composition of a movie is incorrect is not correct. Now what is annotation in 
Chen's document? ''Annotations: Hyperlink specifications for objects inside the media stream'' The precedmg text 
excerpts clearly indicate that Hyperlinks are annotations. The text excerpts also show that annotations/ hyperlink 

specifications correspond to media streams.) (page 3) Selected by a user, wherein each of the 
plurality of annotations (page 3) corresponds to a media stream or to one or more media 
streams (i.e., a movie (i.e., audio and video)) (page 7); presenting a plurality of annotation 
identifiers (i.e. the hierarchical indexes in Figure 4) to the user; allowing the Ordering of the 
plurality of annotation identifiers to be changed by the user (i.e.. The Examiner akeady has 

shown that annotations are hyperlinks, and the annotations are used for dynamic composition of continuous media 
e.g., movie. The Apphcant argues that Chen does not teach presenting annotations with their corresponding media 
stream in the desired order and does not allow reordering the annotations. ''A new sequence of video and audio 
should be composable of whole, or parts of existing clips. ... Our model of continuous media integrates video and 
audio documents with their meta information. That is meta information is stored together with the encoded video 
and audio. Several classes of meta information are included in the model. These are: ... Annotations: Hyperlink 
specifications for objects inside the media streams " The preceding text excerpts clearly indicates that meta 
information, which includes annotations (i.e., hyperlinks) are stored with their corresponding media streams. Now 
the question is does the annotations allow reordering the actual movie segments? ''The continuous media model also 
allows dynamic composition. A video presentation can use parts of existing movies as components. For example, 
a presentation of Urbana-Champaign can be a video composed of several segment from other movies. As shown 
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in Figure 7, the campus overview segment can be used in the composition. " The preceding text excerpts clearly 
indicate that a continuous media e.g., movie can be dynamically composed of movie segments/clips from other 
movies i.e., the clips can be mixed and matched or reordered. Now the question is how does Chen do it? ''Project 
Vosaic bases its architecture on the continuous media model outlined above, Meta-information is stored on the 
server side together with the media clips. ... Semantic descriptions and annotations are used for searching video 
material and hyperlinking inside video streams. We designed and implemented tools for the extraction and 
construction of continuous media meta-information. A parser was developed to extract inherent properties from 
encoded mpeg video and audio streams. A link-editor was implemented for the specification of hyperlinks within 
video streams. '* 
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The preceding text excerpts and the figures clearly indicates that meta information i.e., information about video clips 
includes semantic descriptions and annotations. Semantic descriptions describe/ represent the video clip and the 
annotation i.e., hyperlinks (The Examiner has already shown that annotations are hyperlinks) actually links 
different clips, Chen teaches a link editor where the annotations provide support for the composition of the reordered 
video clips. **We are also experimenting with dynamic composition of video. For example. Figure 5 illustrates the 
result of search on a video database. The search result is a server generated dynamic composition of the matched 
clips. The resulting presentation is a movie made up of video clips in the search result. In general, users may use 
dynamic composition facilities to create and author continuous media presentations by reusing video segments 
through this facility. The organization of video through dynamic composition reduces the need for the copying of 
large video and audio documents. ... Video frames are grouped and descriptions are associated with the groups. 
The descriptions are stored and used for search and hierarchical structure presentation. " The preceding text 
excerpts reinforces the topic of previous discussion. The semantic descriptions are associated with a group of 
frames or clips. With the help of a link editor a client can dynamically compose a continuous media i.e., movie (i.e., 
it does not require any user intervention during the length of the play) by specifying the order of annotations (i.e., 
hyperlinks). A continuous media is continuous because it does not require any user intervention during the play of 
the movie. Finally, The Applicant's argument that Chen does not teach "graphically ordering the annotations and 
sequentially presenting the annotations along with their corresponding identified media stream segments in the 
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desired order" is not proper.) (page 3; page 7; page 11; page 14); seaiTlleSSly (i.e., "The goal of Vosaic 
project[4] is to seamlessly integrate the organization, retrieval and navigation of continuous media into the World 

Wide Web.") (page 2) providing One or more of , the plurality of annotations, and at least a 
portion of the media stream (page 7) corresponding to each of the plurality of annotations 
(page 3; page 7; page 11; page 14); wherein seamlessly (page 2) providing comprises seamlessly 
(page 2) providing the one or more of the plurality of annotations and the portions of the 
media stream (page 7) corresponding to each of the plurality of annotations in an order 
defined by the order of the plurality of annotation identifiers (page 3; page 7; page ii; page 14). 

Conclusion 

7. THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). Applicant is reminded 
of the extension of time policy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the date of this final action. 
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8. Any inquiry concerning this communication or earlier communications from the 
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4080. The examiner can nomrially be reached on Monday - Thursday 8:00 A.M. to 4:30 
P.M. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Jeffrey Gaffin can be reached at (571) 272-4146. The fax numbers for the 
group is (571)273-8300. 

Any inquiry of a general nature or relating to the status of this application should 
be directed to the Group receptionist whose telephone number is (703) 305-9600. 
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